SPECIFICATION 

Electronic Version 1.2.8 
Stylesheet Version 1.0 

[SENSING STRATEGY FOR 
DAMAGE MITIGATION IN 
COMPATABILITY SITUATIONS] 

Background of Invention 

[0001] . Technical Field 

[0002] The present invention relates generally to crash detection and damage mitigation 
systems for automotive vehicles, and more particularly to external airbag deployment 
in crash situations. 

[0003] Background Art 

[0004] Due to the current density of traffic on the roads, motor vehicle operators are 
flooded with information. Consequently, operating a motor vehicle is a complex 
procedure in which various situations occur in which the operator has limited, little, or 
no time to react or to manually engage safety measures. 

[0005] Many previously known crash detection systems have incorporated crash detection 
algorithms based on sensed data. The application of remote sensing systems using 
radar, lidar, and vision-based technologies for object detection, tracking, alarm 
processing, and potential safety countermeasure activation is well known in the art. 

[0006] Based on range and bearing information provided by radar, lidar or vision-based 
sensing systems and additional information obtained from the host vehicle sensors, 
various algorithms have been used to track the paths of host and target vehicles. 
Algorithms have also been incorporated to estimate the future position of obstacles or 
vehicles in the host vehicle path. 

[0007] Some safety systems, such as front and side airbags, activate after physical 
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contact occurs between two vehicles. A typical airbag deploys within approximately 
70ms. Both active and passive safety countermeasures can take advantage of pre- 
crash sensing. For example, a typical motorized retractable belt requires about 200ms 
or more to reduce the slack in the belt system and pull the driver closer to the seat. 
Through accident prediction, additional time is generated for the deployment of active 
and passive countermeasures. 

[0008] Currently, accident prediction algorithms are used primarily for collision warning 
and avoidance and therefore typically cover ranges up to a few hundred meters ahead 
of the host vehicle. However, in unavoidable collision situations, the range under 
consideration is substantially shorter. Therefore, damage minimization techniques 
must predict an unavoidable collision and deploy safety measures within a short time. 

[0009] For pre-crash sensing, vehicle sensors need to not only detect possible threats 
but classify them as well. Classifications are often broken down into different target 
categories, such as: target vehicle type, wall, pole, and pedestrian. 

[0010] For situations involving the target vehicle category, a classification scheme is 

patent pending for Ford Global Technologies to determine the direction and angle of 
the target vehicle and its type, e.g., frontal view of a car, side view of an SUV^ and rear 
view of a large truck. 

[001 1] The limitations associated with current accident damage minimization techniques 
have made it apparent that a new technique to minimize collision damage is needed. 
The new technique should predict a target vehicle's position with respect to a host 
vehicle and should also provide a deployment decision tailored to the nature and time 
requirement of the countermeasure. The new technique should also reduce structural 
damage incurred by the host and target vehicles. The present invention is directed to 
these ends. 

Summary of Invention 

[0012] The present invention provides a remote, non-contact-sensing- based, crash 
threat assessment system. The present invention also provides a non-contact- 
sensing-based, crash threat assessment system for an automobile. 
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[001 3] In accordance with the present invention, a crash assessment and safety device 
activation system, which includes a first target object potentially colliding with a host 
object in motion, is disclosed. A first remote sensor is coupled to the host object and 
adapted to detect a first target object within a region sensed thereby and generate a 
first signal. A visual sensor is also coupled to the host object and adapted to sense 
the region sensed by the first remote sensor and there from generate a visual signal. 
A first safety device actuator is coupled to the host object and adapted to activate a 
first safety device. A controller is adapted to receive the visual signal and is further 
adapted to generate a confirmation signal for the first target object through checking 
the first object signal with the visual signal. The controller is still further adapted to 
control the first safety device actuator in response to the confirmation signal. 

[0014] A crash threat assessment and damage mitigation method for a host vehicle in 
motion including a first remote sensor coupled thereto, a second remote sensor 
coupled thereto, and a visual sensor coupled thereto. The first remote sensor senses a 
first target object and generates a first object signal from it. The first object signal is 
verified by polling the first object signal and a signal from the second remote sensor. 
The first target object is visually confirmed with the visual sensor. The controller then 
determines whether a potential for crash is within a safety device activation threshold. 
An external airbag is then deployed in response to a determination that the first target 
object is a vehicle and that the host vehicle will crash into the first target object such 
that damage or injury resultant from the crash will be reduced by deployment of the 
external airbag. 

[0015] Advantages of the current invention are that remote sensing of target objects in a 
region in front of the host vehicle is used and threat assessment is made through a 
fast, robust and reliable algorithm. Additionally, the verification scheme involving a 
visual sensor or camera is used in conjunction with another remote sensor to improve 
accuracy and prevent safety device misfires. 

[0016] Additional advantages and features of the present invention will become apparent 
from the description that follows and may be realized by the instrumentalities and 
combinations particularly pointed out in the appended claims, taken in conjunction 
with the accompanying drawings. 
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Brief Description of Drawings 

[001 7] FIGURE 1 is a crash assessment and safety device activation system in accordance 
with a preferred embodiment of the present invention; 

[001 8] FIGURE 2 is a block diagram of a crash assessment and safety device activation 
method, incorporating at least two remote sensors, in accordance with another 
embodiment of the present invention; 

[001 9] FIGURE 3 is a block diagram of a crash assessment and safety device activation 
method, incorporating at least three remote sensors, in accordance with another 
embodiment of the present invention; 

[0020] FIGURE 4 is a block diagram of a method for host and target vehicle speed 

considerations in accordance with one embodiment of the present invention; and 

[0021] FIGURE 5 is a diagram illustrating the direction and speed ranges permitted for the 
target vehicle; and 

[0022] FIGURE 6 is a block diagram of a classifying system for a target, in accordance 
with another embodiment of the present invention. 

Detailed Description 

[0023] The present invention is illustrated with respect to a crash assessment and safety 
device activation system 1 , particularly suited to the automotive field. The present 
invention is, however, applicable to various other uses that may require crash 
assessment, as will be understood by one skilled in the art. 

[0024] Referring to FIGURE 1 , a crash assessment and safety device activation system 1 , 
including a first target object (here illustrated as a first target vehicle 2 moving 
upwards) potentially colliding with a host object (here illustrated as a host vehicle 3 
moving to the left), is illustrated. 

[0025] One embodiment of the host vehicle 3 includes at least two remote sensors 

coupled to the host vehicle (1 2 and 6 or 1 2, 4 and 5). A controller 8 and at least one 
safety device actuator (7, 1 6) are also coupled to the host vehicle. Still further 
included is at least one safety device (9, 1 4) coupled to the vehicle 3. 
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[0026] The first target object is an object, either stationary or in motion, that has a high 
potential for crash with the host vehicle 3. High potential for crash will be discussed 
later. 

[0027] The host vehicle 3 is an object in motion, mounted with at least two remote 

sensors (12 and 6 or 12, 4 and 5). The embodied host vehicle 3 is an SUV, however, 
alternate embodiments include cars trucks and other known modes of transportation. 

[0028] The remote sensors (or sensing system) detect vehicle states (dynamics) of the 

- first target vehicle 2. Ideally, the sensing system includes at least one radar sensor (4 
and 5, or 6 alone) and at least one vision based sensor 1 2. However, numerous 
combinations including multiple radars (4, 5), lidar, or vision sensor only based 
remote sensing systems are included in alternate embodiments of the present 
invention. In one possible combination the area 1 1 sensed by the radar sensors 4, 5 is 
illustrated in front of the host vehicle 3 and is defined by two triangles illustrating 
typical radar sensor range. Both radars 4, 5 are ideally angled away from each other 
so that there is little or no overlap between them. An alternate embodiment includes 
the sensor 6 sensing a triangular area 1 0. The area 1 3 sensed by the vision sensor 1 2 
is also defined by a triangular region illustrating a typical vision sensor range. The 
sensors generate target vehicle 2 or target object signals, as will be discussed later. 

[0029] At least one safety device actuator is coupled to the host vehicle. The present 
invention includes an external airbag actuator 7 (first actuator), and a crash device 
actuator 16 (second actuator). The first safety device actuator 7 is coupled to the host 
vehicle 3. This actuator 7 activates the first safety device 9, here embodied as an 
external airbag. The second safety device actuator 1 6 is also coupled to the host 
vehicle 3. The second safety device actuator 1 6, here embodied as a crash device 
actuator, activates other internal safety devices 14, such as seat-belt retractors, 
airbags and the like. It is important to note that numerous actuators and safety 
devices may be added to the system as needed by the manufacturer, as will be 
understood by one skilled in the art. 

[0030] Each individual safety device has a substantially unique time requirement to 

become fully effective, and the decision to activate a particular safety device takes this 
unique time requirement into consideration. For example, the activation decision time 
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for motorized belt retraction is earlier than for pre-arming airbags due to relatively 
longer deployment time requirements for it. A method for determining when to deploy 
the external airbag will be discussed later with reference to FIGURE 5. 

[0031] The safety device controller 8 is also coupled to the host vehicle 3. The controller 
8 receives the sensor signals and estimates therefrom the future position of the target 
vehicle 2, with respect to the host vehicle 3, to determine which safety devices should 
activate. The controller 8 also estimates whether a potential for crash between the 
host vehicle 3 and the first target vehicle 2 is within the threshold criteria for the 
safety device actuator 7, based on the activation time considerations of the first safety 
device 9. 

[0032] The critical zone 1 5 for external airbag activation is illustrated with a rectangular 
region about three meters long and as wide as the host vehicle in front of the host 
vehicle 3. The vision system is included to make a "vehicle - no vehicle" determination 
in a region within the coverage zone of the radars in a time frame needed for the 
external bag deployment. Thus the vision system must be able to scan a region in 
front of the host vehicle and give a determination the instant an object has entered 
the critical zone 1 5 in front of the vehicle as to whether it is a vehicle or not. To 
achieve this, the image processing should have made this type determination at least 
one update cycle prior to the object reaching this boundary. 

[0033] The controller 8 also estimates whether a potential for a crash between the host 
vehicle 3 and the first target vehicle 2 is within alternate threshold criteria for the 
other safety device actuators, based on the activation time considerations of other 
host vehicle safety devices such as motorized seatbelt retractors and internal airbags, 
as will be understood by one skilled in the art. The operations of the controller 8 will 
be discussed in detail later. 

[0034] Referring to FIGURE 2, a block diagram of a crash assessment and safety device 
activation method 30, incorporating at least two remote sensors, in accordance with 
another embodiment of the present invention, is illustrated. 

[0035] 

Logic starts in operation block 32 where a single radar senses an object in the 
path of the host vehicle and generates therefrom an object signal. Important to note is 
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that the radar is one embodiment and alternate embodiments include lidar, or vision 
sensor based remote sensing systems. 

[0036] In operation block 34, the object signal is received in the controller, which makes 
a determination as to the nature of the signal and whether speeds are within the 
system activation range, as will be discussed in regards to FIGURES 4 and 5. 

[0037] In operation block 35, the target closing speed, Vc, is computed using the sensing 
system ability to either measure it directly (e.g., through a Doppler process) or by 
differencing distance measurements overtime. In inquiry block 36, a check is made as 
to whether time is crucial for deployment of the external airbag. This is determined by 
comparing the current distance to the target against the closing speed times the 
countermeasure deployment time requirement. For a positive response, the airbag is 
not deployed (i.e. return to operation block 32), and the system continues monitoring 
the target. 

[0038] Otherwise, in inquiry block 40, a check is made whether the radar still "sees"or 

senses the target and whether the vision sensor is sensing that the object is a vehicle 
and that it is positioned directly in front of the host (bullet) vehicle. For a negative 
response, the system continues monitoring the target, and the bag is not deployed. 
Otherwise in operation block 42, the bag is deployed, i.e. fired. 

[0039] Referring to FIGURE 3 a block diagram of a crash assessment and safety device 

activation method 49, incorporating at least three remote sensors, in accordance with 
another embodiment of the present invention, is illustrated. 

[0040] Logic starts in operation blocks 50 when sensor data is read into the controller. In 
operation block 51 , the first radar senses an object or "threat"in the path of the host 
vehicle and generates therefrom a first object signal. Important to note is that the 
radar is one embodiment and alternate embodiments include lidar, or vision sensor 
based remote sensing systems. 

[0041] | n operation block 52, a second radar may also sense the object or "threat" and 
generates therefrom a second object signal. This dual sensing of an object provides 
increased accuracy in threat determinations and reduces the likelihood of inaccurate 
target signals. In this embodiment, it is not necessary for the second radar to detect 
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the target at the same time as the first. It is only necessary for both the radars to 
confirm the presence of the object in its field of view as the object enters the critical 
zone. To illustrate the above concept, in FIGURE 3, radar A is shown as assessing the 
object signal or threat for example by tracking the object and by performing speed 
analysis and radar B is shown as just confirming the presence of the object. In reality, 
both the radars can assess the threat, or radar A or B can assess the threat and the 
other radar can confirm the presence of the object in its field of view. 

[0042] In operation block 53 the target closing velocity Vc is calculated. In operation 
block 54, the controller makes a determination based on host and target vehicle 
speeds, as will be discussed in regards to FIGURE 4. 

[0043] In the operational block 55 both radar units are continually polled. In inquiry block 
56, a determination is made as to whether both radars see the same target, i.e., have 
a signal at basically the same radial distance. This is critical as it helps define the 
lateral extent of the target. A large target that extends across the front of the host 
vehicle is more likely to be a legitimate target (i.e., a vehicle) that will be hit flushly. In 
operation block 56, both object signals are received in the controller. The controller 
analyzes the signals (i.e. polls the radars) to determine whether the target object is 
sensed by both radars. 

[0044] In inquiry block 57, a check is made as to whether time is crucial for deployment 
of the external airbag. This is determined by comparing the current distance to the 
target against the closing speed times the countermeasure deployment time 
requirement. For a positive response, continue monitoring the target. 

[0045] For a negative response to inquiry block 57, a check is made in inquiry block 58 
as to whether the vision sensor is sensing that the object is a vehicle. For a negative 
response, the airbag is not deployed. Otherwise, operation block 62 activates and the 
external airbag is deployed. 

[0046] 

As an illustrative example for a target object entering from the left, let's begin by 
assuming that the vision system detects the object. The target is judged a vehicle and 
legitimate threat if it is in the critical zone and it has sufficient vertical extent and the 
left edge of the object occurs before the left side of the host vehicle and the right 
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edge of the object extends into the right half of the visual field. For an object entering 
from the right, the procedure is similar to above but reversed. For an object entering 
centrally, the target is judged a vehicle and legitimate threat if the image has 
sufficient vertical extent and either the left edge of the object extends past the left 
side of the host vehicle the right edge of the object extends into the right half of the 
visual field. Important to note is that sufficient vertical extent is determined as a 
function of the camera position, field of view, and characteristics for a vehicle at the 
appropriate distance, as will be discussed regarding FIGURE 6. 

[0047] Given that the bag is to be deployed when the host vehicle is the aggressor, the 
approach angle of the target vehicle can range from directly ahead to +/- 45 ° from 
the corners of the host vehicle (the latter is the case for equal speeds on orthogonal 
trajectories). 

[0048] The default state for the vision system is ideally "no vehicle present," and the 
airbag deploys only when hitting a vehicle. 

[0049] In FIGURE 4 a block diagram of a method 80 for host and target vehicle speed 
considerations, in accordance with one embodiment of the present invention, is 
illustrated. 

[0050] Logic starts in inquiry block 82 where a check is made as to whether the host 

speed is greater than 24kph. For a negative response, the host is moving too slowly to 
receive much benefit from the external airbag, and therefore, in operation block 84, 
the bag is not fired. 

[0051] Otherwise, in inquiry block 86, a check is made whether the host speed is less 
than 64kph. For a negative response, operation block 88 activates, and a 
determination is made that the host object is moving too fast to benefit from 
deployment of the external airbag. 

[0052] In operation block 89, V is computed. V is given by: 

tarqet target 

V Iarsc , = Vc . - host vehicle speed: 
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[0053] Here Vc is the closing velocity between the two objects or vehicles (obtained from 
radar signals). 

[0054] In inquiry block 90, a check is made whether the absolute value of the target 
velocity (in the direction of travel of the host vehicle) is less than the minimum 
velocity parameter, V 

tarqetmin 

[0055] For a negative response, in operation block 91 , no signal for airbag activation is 
given, as the target angle and speed are unfavorable for airbag activation, which will 
be discussed later. 

[0056] The probability that the host vehicle will hit the target vehicle on the target vehicle 
side when a collision occurs is given by: 

[0057] 

l 

B w +T l V 8 

[0058] 

[0059] The subscripts w and I are for the width and lengths of the host vehicle B, and the 
target vehicle T. If the target vehicle is traveling at an angle 9 , with respect to the 
horizontal, then the probability becomes: 

[0060] 

Tcosfl/ 

/fccos9+Tgsin|e|) 



[0061] The ~ represents the actual dimensions and the * represents the new width and 
length of a box enclosing the target vehicle moving at the angle 6 (measured as the 
angle of the target vehicle from horizontal). 

[0062] 

In inquiry block 94, a check is made whether V is greater than V .V is 

C side side 
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the velocity threshold of incompatibility in side impact, i.e. when it would not be 
beneficial to fire the airbag. For a negative response, operation block 96 activates and 
a determination is made that the situation is not severe enough to fire the airbag. 

[0063] Otherwise, in inquiry block 98, a check is made whether V is less than V 

sidelimit ' where V sidelimit ' S the maximum s P eed over which the sensing can reliably 
perform. For a negative response, operation block 1 00 activates and a determination 
is made that the speed is too high. Therefore, the airbag is not fired. 

[0064] Otherwise, in operation block 102, a determination is made that the threat is 

valid. A check is made whether V multiplied by T is less than D . T is system 

c r r r 

time response and D ^ is the distance from the radar to the target. If it is, then it is too 

early to fire the airbag for effective protection, and the airbag is not fired. Otherwise, 

the airbag is fired. 

[0065] Referring again to operation block 91 , the decision not to activate the airbag 

system is made based on the speed and orientation of the target vehicle relative to the 

host vehicle. FIGURE 5 illustrates this. The target vehicle 1 1 0 can travel in any 

direction, as indicated by a number of direction arrows (the bullet, host vehicle 1 1 2, is 

. assumed to be traveling upwards in this illustration). The lengths of the arrows can 

correspond to the velocity of the target. By setting a value for the parameter V 

. it can be seen that for any direction and speed of the target vehicle, only 
targetmin y 

those whose arrows fit in between the two boundary lines (at +/- V ) will 

targetmin 

pass with a "system on" status and pass through inquiry block 90. For example, 
consider the target 1 1 0 moving in the direction shown in FIGURE 5 but at two different 
speeds illustrated by the short dashed line 1 1 4 and the thicker, longer dashed lines 
1 1 6. The former fits in the bands and so this condition will be considered for bag 
deployment. However, the speed of the latter is too large, and extends past the bands. 
For this case the target 1 10 is moving too fast and the airbag system is not deployed. 



[0066] 



This process allows for the target vehicle 1 10 to be moving at any speed if it is 
orthogonal to the path of the host vehicle 112. However, as the target 1 1 0 rotates 
away from the orthogonal, a constraint is imposed on the speed allowed, and this 
constraint increases as the vehicle 1 1 0 turns more and more from an orthogonal path. 
One can also see that a target 1 1 0 moving directly towards as well as directly away 
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from the host 1 1 2 is permitted, albeit at low relative speeds. All of this is controlled 

by a judicious choice of the parameter V . . 

tarqetmin 

[0067] Advantages of having a small value for V are that this properly biases 

targetmin 

system activation towards only side-moving targets, reduces false positives resulting 
from close pass-by of vehicles moving in opposite directions (radar will reject without 
asking vision for confirmation), and places no restriction on target speed when 
traveling orthogonally to host vehicle. 

[0068] One observation from accident data is that side impacts occur predominantly 

where the target is oriented between 0 and ± 30 ° from an orthogonal direction to the 
direction of travel of the host vehicle, and one embodiment includes this as the cutoff 
angle for the external airbag. External bumper airbags provide significant benefits in 
improving vehicle-to-vehicle compatibility in side impacts in addition to providing 
enhanced protection to the occupants of the host vehicles. 

[0069] Referring to FIGURE 6, a block diagram 1 30 of a classifying method for a host 
vehicle, in accordance with one embodiment of the present invention, is illustrated. 
Logic starts in operation block 1 32 where a target object is sensed from a vision 
sensor on the host vehicle. The sensor data is received in the controller, and the 
object box dimensions for the bounding box for the target object is generated. In 
operation block 134 these pixel dimensions for the bounding box are converted into 
metric physical dimensions using the characteristics of the vision system. 

[0070] The analysis phase then begins with an inquiry in block 1 36 as to whether the 
target object has a height less than 2.5 meters and a width less than 1 meter. For a 
positive response, block 1 38 activates, and a pedestrian classification is made for the 
target object. 

[0071] Otherwise, inquiry block 140 activates, and an inquiry is made as to whether the 
target object vertically spans the visual field of the sensor. 

[0072] For a positive response to inquiry block 140, an inquiry is made in block 142 as to 
whether the target object horizontal width is less than 1 .5 meters. For a negative 
response, the target object is classified as a wall in operation block 146. Otherwise, 
the target object is classified a tree or a pole in operation block 1 44. 
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[0073] For a negative response to inquiry block 140, an inquiry is made in inquiry block 
148 as to whether the target object vertical extent is greater than a prescribed height 
H2. For a positive response, operation block 1 50 activates, and the target object is 
classified as a truck. 

[0074] Otherwise, an inquiry is made in inquiry block 1 54 as to whether the vertical 
extent of the target object is greater than a prescribed height HI . For a positive 
response, operation block 1 56 activates, and the target object is classified as an SUV. 

[0075] Otherwise, operation block 1 58 activates, and the target object is classified as a 
car. The rotation angle of the target vehicle is then estimated in operation block 1 52. 
Based on this visual classification, the external airbag may be activated only when the 
object is confirmed as a car or a SUV. The system can be further refined by estimating 
the angle of impact and, with this information, decide to deploy only if the side of the 
vehicle is being struck, for example. 

[0076] In operation, the crash threat assessment and damage mitigation method for a 
host vehicle in motion includes a first remote sensor coupled thereto, a second 
remote sensor coupled thereto, and a visual sensor coupled thereto. The first remote 
sensor senses a first target object and generates a first object signal there from. A 
check is made of the first object signal by polling the first object signal and a signal 
from the second remote sensor of an area in front of the host vehicle. When the 
second sensor (for a host vehicle including a second remote sensor) verifies the 
existence of the target object, a visual sensor visually confirms the first target object. 
The visual sensor also ideally uses object recognition software to determine the nature 
of the target object, which is to be used in the countermeasure deployment 
considerations. When a potential for crash is within a safety device activation 
threshold, an external airbag is deployed. 

[0077] From tne foregoing, it can be seen that there has been brought to the art a new 
remote sensing based crash assessment and damage mitigation system. It is to be 
understood that the preceding description of the preferred embodiment is merely 
illustrative of some of the many specific embodiments that represent applications of 
the principles of the present invention. Numerous and other arrangements would be 
evident to those skilled in the art without departing from the scope of the invention as 
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defined by the following claims. 

[0078] 
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